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Signals 
Related Appiscatmrs Data 

\'o i>0 1 9*>,48i, entitled J mbeddsd r*^a and D*5ta Sciajnblmg 1 m>io\ emoms, BicJ 
Maro 1 8 3000 by Ktsii Xj£V> wkdi is lau^ipoi atssd by t cieiet^i^ 1 hi^ p itcM 
<3pt)hc£Jtios also cUitBs fee benefit of U S Provxsiotial f^xmi Acppli^-ativi No 

Matugansx^v oi DtKumcnt and Oitt«*r Objt,as I siigi.>pUcai0.oiv.cs, flev.1 \, m-^i ^ 
200Qv bv Ssjdsr^ Csnr^ Perry, Grahasa* ^d R:boa<te^ wfaich: is hereby mcorporated by 
reference, 

TbiS patem q)plicatt0n is also related to lJ.S. Patent Appbcatjoa 09/7(S«},505, 
eriutle<l Batch Idmt3&r Begistraiiotj laid Bffibeddmg m Media Signals tiLxl Nb'v amhm 
> ^000 b V Mcki rd^Y aad Hem, ^ hich lasrcbv mcoTpo^ ated bv i efertrpc e 

* N ' sou vvJi^iiCwUsu J^o -^^ <uK b *j>v io-^ '-^ Wi' 



Teehmeal Field 
stegajjoitspliy. digital waimjisjMag aad data Mdl»g, 



Bael«grouBct and Summary 

£ "^esJ a I ch Tis. rond t>k code »to tK mc tia Ihc tb<, tUa u t% be r ^-Ji. U«?d "xiiv i: { i it 
th^. uUstdded code i\ impe cqjtibk oi nt^yx npt ce >tibl ?o (he \ « be 

? T II t \hi\ V?), >5oB;matt, tni1*i d*mv.i sioml 

1 1 a I u 1 c 

10 U k n rii? I )« IS] 1 ^1 \ h s i 

n * s I ^ t m > \ }0 h m i h i\ 

la u p<xi V5 ul> ll^c ent- xlu cmbtd<5 \s *jtej u<»ik b> alls, n„ U t. host M^di'i ^ y 
Thsti. dni,«,ot»por*ss* m "-put ^ i1 to detect v 111.1^61-^%^ ^vti^iajki^ 

this mto»?iasiOii immtlie detected watemwk. 

bews^ pattJGUlar wscermarkts^g: techmques have b&m. developed* a»ds tor 
T ihiwi v>. it^i m ks the is>^^ is to dv an i-nperouptible *rk U a hut ^ v t 

t \\x U ^ xi \ I ^ 

20 I <; 5 I h n t ^ 1 t 1 I -t i f 1 nu c S 

\ li U u'^-'p a<,lH ^ Ki'^e W U<;i nil m )ii ist is 

h.d p t^a to f liK tL and halftOTiv na^ ^ ir^ U k>n'i « L T \tv,ni: A ?pU au u \ 
25 1 9 O''^ em t ui M tb,ods ard bastes toi ater i k I?k)cc<;<5jt^ si Li e ^ti 
liT\at,e<} 4)9 6^0j,2'?6 ta'itled Halitonv \\ atem aMni, axid Reu ©d A.pp!K Xjot and 

( (.nt Ucd RIOoR Frminwfc W^ttrmark and Rcltu! App! r fto s \\ hu h 
\ h« X n « CO po atvd bv {tfo t,aev 

1 us JTkin ppi 4. non\ \ t n.1 ledhtt i lu*. t i sU Jtcttsi ik> are 
30 k.1 1 I ik 11 Ut.tji5 Hag Ic A.rt.^hii \ ti o v^&isrtxiftk 

t its. <- 5 It uj «, ^ i^'ii ule\^.nn he -> <;|,ax m •> i%. \ite mk-s-d 



I. '( K ' u U5l ^ 1 i I ^ 5 I. i ^nna ' >^ >, 

t„( u < <- mil! JO' ^' tu-^.L "5^aeru.J;i j i p b ovv m n o'.o oi 

roncqst*. ft agJi <5t)d n>%dt watetm^iks ihtsc typos ot \v<iictararks do^^i^act.^ to 
.Sisrvivt certaui types of pnxcssing Lke coixsprcssiioti ytX da^^i topt-ti'ig ^ske Cfcppx^i, 
o sw4|spmg of Sigjsals Ft^gik aud ^m^fegik %«4tcmjarks may H ?ss^ tt, ta^^/e* 
certain actions ox coatrol usage of the watuisajked coatmt wtei vkgraOatioti ot fae 

10 fmgde watermark IS ds^^ected. 

In dtgskUK \%.4<erm<isk'nt' t>iv?d*'$ Mgrnis, 'm^h. m>ho, &Xi\l images mdYst?t^. 
tbeic aye a t s. M t I n < > ; s u ^ < >sw challenge to smbsfd the 

%\atcnuaik o h 't i ^ i "^k <; !^ ^>-\ u x k) ] v p. f ujirrst'i oCatutCvN arUcipatoc fo; 
tlif a^xns^ J oil Ic mak. s t t . jtx is ^lai'Livut v {, pi^ >L tl r 

15 that Jijr?iic<UKMi or ?cra^ ippbcnxios, it nat ;>0cstKc to v <5rs\^ip.Uc ^ no \ \pes of 
p30co?i>.Bg lhat a media obit-ot %x IE s-ttcountex, ewa byfbic U li. JjsttiVinod Fo; 
exau>|>b. a xxtij&ic xtA<:\. tm^ hc: ^swdaced md distributed m a tiumb«f of vHt\biv,ut 
fortsiafef (diffc^rmt compr«ss>m« ratess difeent cotsiprcssion codecs, diffesrstit broadctm 
&tiiiat«x «tc,) Each of these tb«ii3ts may degrade or distoxl; ttse waJer«wlc dii^rently. 

20 In addition, the xnn&ic track may be mider^d u4ag btgh fidelity audio a|tupt)ent, or 
lower <|tiaJity equlpfment, giv^ki® rise to dit&sreat perceptual q-uality constraints; M 
px«liculaj\ lower quality r^dering srtabless ibe watermark to be embedded more 
kHis'J\ Vofiu§? pe\ccftibtbty constraints oti the \vf\tonn^sr«v <rc \ - ^ ^unrro' ' sio 
sauv kuo toi vjdco ssigixa's, like mones> tele^iSit^i piO«j nrx:.- co vit^«>i. iiou^s 

as et^. 

CorsSbli u lOt a^au\pK\ !uapl\ic art i?vd m aOvcitisemctsis, p^icl-i^'iag, cu-o. I W'Uh.^cs 
Saoh art mu\.pss:y may include a colleetjon of a raster images* that are combmed to form 
30 a t1«ai i^fige. For a particuiar design project, the graphic arrist creates a pjocc of 
eaapbte sitl toe a custosHr. typjcsUy uui«dt% a c^-vJIectioa of constiioenr unsgcs m. 
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5 \ ■.\4<m-i^i uvis \v<.u->l to ap^^lv a WitWiuark io i.n<il -rri^^^; f !\-sJu.ci for a. 

vanetv of fipphcatjons, MKh. d% m!ji«-img a c«'?wmct ic^eutUtor tor Udckul^:■ putposo^ 
llnkhig the m&go to the customer's web site, «tc. Th«te are tvi'o maia probkmSf 
poteatialiy inter-txlatsjd. One probleit^ occutij with the coBtsrji flow and tiBtiag of 
addtiig the wateti lasls: fkm Another pK>ljicra ocms m{h <^dd ^tg wal^iaiis to \ sotor 
^phies. Ihe jstago At whidi the wateimaik mcs&ago p<ivioa{l asxi ciubfidduig 
piu axmu s> are defined n ay tiof always be tiK" approprj. v <; ago <o c«ibsd the 
watenriark n*biS>^!M ^ ? O ni-tci. Iocj^jtbedtbome$v?cpny1o< loi^hc 

irij,f<, ior.n< i ^oxnp nh^c x^^^i) Lrv, j i.j iuc u< tdou"- ^oti h>ct.~> or<.s or 
a<!ve ryioi phj eg o^- ppoi c'o e <^ d al 'xcjty puss*. jct? o, a^^t' t^, usv ct 
connhpommg ^ix^l i«c*iiJoi5s> The RIP stage usually occi«& <il tho Piv-;. Jtr-ss^s 'lOute or 
I'rmter, aad seqmi^s &e |jersoB wrth most mttcai eye for color, fe addjtiorsv this 
tagc, bv d<?fiaitio«, rmihn m a complete rostei Sjsaagc ^lic waterm(«r& ca bo dcJm^d 

vector ^^mcs (or lav hut xs liht nately estjbeJded m a tA<^tsi j «af c w! en 
pnatMATith mmaoa aaodem eqiMpment; liieciMomer doesirt ustiaOy interact witiv 
tl c P{ >> Pioss house 05 Pr nter, except to pojssiblv pjoof the iitsdi^e I'i adut^o-^u these 
lotaLo' - Mr>k^ v».nihic tmie 4^.0 s-Obt const ^mts < do n nt to v,\>at ^ st " 
rv'tt C3v\ t . id (, L " ^nttOit^oi itstci?ci.L»u'5 f<Lial % 1 -tio use - ->j , . - .,<^ mi 

1 t <\ " XN-siiCvh^i JlkJit V 41I ^ an I > n a Lag 

5 J fSixl „ a ^ ii,vs'rs f!t.'> "v !5v ^> Hi. -J? 5 ^ { il m - 5 < f< < ma 
a \pl.i\ svTvO'i or {14. <Vop pnmc , \%bicb posc4> iSe orot>tcn-^ ot hrm o cniu> ic 

* ihtf g5^' hie an saj hd-^ io t^dd tee Aitsrmark i ufore d^c fVc<-Fic»s hou?© <n 
?rsrtcr. Ac iph^«, *atisi must ? s^^ct tbo ti ugc T! is C!ia^> s two otoble.u§ i'rsf. 



Si oonC the graph. r 'KKo; ' ^ > > < . . ^. a m . .'i-. :o,o; ■'5K5tu;''v,r..»5 

5 V. u4\ ^ ^Int.' I ic -\-;nk'\*- ot ^no. waknr.ark, 'Siu* the ^va.tuv. ulK'vai\'4\ 

cmbeudcd m tiio ra^iCiS-icJ image m ilic Fcc-Fcos^ iicsitsc or PnBitjr. A ^trndai- probicm 
exists for GXhssK media type^ like audio md video, where watemxark paytoad is 
speoifed at a stage difeeritlfiaa the most a$>proptiaie stage .§>r mjbeddiag the 
was^iSEfk in the coiiteat 
10 if th<5 iaiage file is a vector gi-apliis;, vi?h«taer mideted for priutijsg ^ described 

above, or disJ-sdbtJtcd clsctronicaMy mch. m on thQ web, & pmtx<;xpmi mch 3<: the ot\Tt<i?\ 
may waa^ towatcrr^wik tbc vcctoi giapfoc. U e frxUcwaiii f'^at v j^'^ oojk to bo 
smbvddcd in tUc ifiiKlvj't'd M^uga 'Ahcit'xe Uic or Hk- isious.U,\c<.L io'j aj, on a 
eorapuiet ts^jceu, pu^s^r^ie ^s^.'h^^ - x<-^ i trii^s^^i p^-^vi^ Thih aliosN? lileptim^ile 

\ v,r 50i coiUffjlr\. H<-> ik onHxxM'x"-^ a tu d;a cb througli the 
u;^c it v^aimT^ark emboddmg cuauiia{id descnbed beli>v^ , in tht: procc. si of oreatiug 
tfae madia ob^eotj the j^aethod mciudes a watetmarfc embedding command mxong a 
of ouc or mom rendering commmds ihat specify bow ih& medk object is to be 
20 rmdemi. For exai^ssple, csmm media signal formats liloe PCL, PDF, or postscnpi for 
iimges, MIM mid stt«cajr<^ audio for audio^gaais, atid MPEG-4 aadMPEQ<^7 tbr 
atjdio aad v deo &!gna1s, include descriptois thai control how a pmi&ular media stgrml 

foHov^ iro ■> cnc n idt tni-fkr uss^d to bok to cystomcf Ofv rchit.d coutcxt xiiioinu-tiotL 

■? 10 ^ ^ s j,^ s „ n 0 I mi \^ p< > K u i< 00^ fo; ijr.agos, vx sn: u-ruli 5g 
cos Au V. t 1 f * dia iype& %mta, or diffssrenl partiS oftJie 

u < o -^j.T an Id i k aaennj;i q«iilu.y, 

ihe-vx'atsinui.u)4)vaam„t.0Bmai!di,jaMt, i vUM'^iut:; <jt oj<.a!,< ^ .o.^-at-^ify 
30 -v^dtet ^ia-li^ie«vsas?epa\loid and embedding parasui^kTS srid profereaces, ana enables 
the )ctjdonm« device if omNed the wauymsirk tippropnatcly for a pasticalar rcndedBg 



pnvo-N. lu^Kcrigt: oCv;ra])!iic ;m, ihc o !^^<:i)J' p; ."v .- ^a- the v/facr^aiarksd content 
o5i rtie graphic arli^Os issonitur ir.v^potN'-- e pi \ . -h;.:'. ;.;--lc:i,':es the- Ijua^e for 

vvi«ei~marke<1 image, lu addiuou, the Fre-Pre-xs house ox llumcr, can adci asjU mockiV 
5 the watermark x^'itbo«t intOTctrng witU tb& i?tMo33ier, thertfby s&vmg time ssid rmrmy, 
1xi geaoral, &e watermark embedclii^ eosantaad mciudes tl^e message paylo^d 
to be embMded and Tuks or links to how to smbsd these bits. Thrss, tli® watesi^ark 
fmiGlioTi is impleixjented sccordjsg to tb,e desired emb«ddtag method when Ite grsipliic 
m. is xesidered. s^tch as outke screesv pmted proois or Saalprntuigplatss. 
1 0 This method h exteudeti to other Ijp^ of media objeetSj mdadmg a«dio or 

tnusktmcks,: video ssqixences. etc. 

The advantages of w 5 tv ' >< 1 I'.e > h!<> 

'iviitem>arks can be embedded ji^ ri.njdcrsnt.- a^.<,^:upl]<>n cojUlu'L .such as ^ccli^s srxiplucs, 
>L siuscUmxl MPEG aiuUri si-lso. In addition, x^aicmvark:^ oars be 
15 en,sbfcdded sf. a (Imo aad iocadon scparius,; irom where aud nvhen the ^vjnom-jajt aiid 
conisfll b msdered. This i-edtices cos^ by aHowiag proper iiueiactioa betxvmi tlie 
coateid owner and creatoa-s, "s^'ho have difeent st^ponsibiHdes mid skills. 

The mveEftioafertlier pio^des Bigtfeods ^d related systenssi deykssi aitd 
20 solNfaros for tsanssnarMag media signals^ Transitiarknig reMes to eonvertiag auxsliary 
da^ embedded i« a media si^i fi»m one digiUl wates:i3ark foHsiat to anotJier, . It 'm 
iH<jd processes that sransfomi the media signat such ^ ciOTrpre«<5toti, brn^dcast, 
ouit Ks-di^iitig, etc , chiin;:^ the chaactenstics of tlie cml -ddcd \% ^tcuiaatk so ibat 
hv^\uVfT!<xd h£B'»nprowdtobi'^tne$i-!Ot p^tcmibdilvdj,. ^(.i.t >3 shr?t-*uti.\ 
25 V 0 i r ' so no c.rc. f i <u* ^ £ v s i x ! > to * ^s^^n ck oh >> sand 

< <i<i 3 ^ lit K.t.<.n u-^ tO!i->iv{ Oi UTKa^a ilk. ol «Lx5 invi..dau j.jru\ii^d wiU t.u- uxou 
i s k M! ot L vX T5^ J A \% liiem irk or in f a % e^i ttori a watcmiaxk llnis, tlic 
x'i'aisrmaks appear to he robust to ali trai^stontiatioas, 

Os^c af«peot of djo luveiaaQn n a mUhod of irsnismaTteig a mc^ui stgaa! 
30 psw50«s> et»S5e»lded wttli a ttr^t dtgUal \s alontjaik ossmg a Stst digital watejiEtwk 

emhcddmg mcdiod Thi^ u usaiatko^r^ aitnhod dctcctss. the fxrat ds^nal watenraik st* the 
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<'i soco:kI diiiu.u \s.i,\-rn«3r& m tik' ini,\iia .-i.J:^n.JLl before the moJia aipual ujsdospjfv .^t 
);rvLn,Nfo{o;ritb-<r{ pn>f-c5.s'. The ^second digital ■v'i'atenna-Jsc is adapted to $«rvivi? the 
aajisformadoji process, 
5 Ajiotbor aspect of ihc tnvct^tioo is another jrsetiiod of'tt,m.Ktnsr\:\m .5 ^no^iia 

signal. This »ie(feod detects the ilrst digital watsfrjiai'k in tlae media sipial, converts the 
media mg^&l to a difeeat format, and embsds message mfomatioij. Itom die Stst 
diigitsi watermark into a s«oo»d distal watenjjaiic m the coiiver le<i naedia s%3ai< The 
second digital watennai-fc is adapted to sobtisMess or pei-c^^tlbliits' |jat^eters 
10 assixjsated witfe tfa.e stew fotm^v 

Furdi^f featiires will become apparent wi& reference to ifee iMiowkg detailed 
descriptloti aad aecompaiiyisg drsMxigs. 



Brief DesGriptron of tii^ Drawings 

15 Flgurs. ; <i lh< ^.'UKK fc? a\ J'tdi^n^ a featuj^hastjd watemiaik to ease semiii^sg 

F3gU5C I a: Biagram fwretneving a featurc~bas«jd watermark to es?e soarcbing a 
large mmgQ lor a ssiaJi watenuarked area. 

Figm& 2; This flgiJt^diows apseado-ra»dom»<>i«e array &a£eaiibe ased to 
20 det«riain:e the scalMg attdTOtats0?i of sivimage via autoeoitektioa. 

Bigam3; this figuKsdemonstmss tlieartof siomsg the iraiiisition between 
eB^beddiJig Jiuxdia?-)' O's asid I's, 

I ip5H 4d TM& iigia^e shtn^s lUs- giid u.^«;dte cu>bed axj autocon-eJaiioii-bascd 
watsmis«-k\ 

o J'-ni.^ *K i^iR'i. ion i-^A^jn ajr^ocoav . o J inM^'t;, X's represcal 

watenjiarfe is? a Rigdia sigfial is trgasmarifesd iato a seeoad digital \wtemiark: m the 
3© atedlasi^isl. 



I'ig, 6 is a diagram iUustratmg a watennsrk embedding function a»d retJ,de.dag 

desoriptkm iik. 

Fig, 7 is a di;.i:-.o:.;i sHu . ■.io'in>; ■;>;v::cess for embed<3ing walemiarks in media 
obj«rcts ui55ag v.ait-rmai'k osu'\ ^ ^\ ^ \ )r ^^t' 

5 Delailecl Descrlptloii 

FBatijre Based Watmmtk 

Wucii ushig sioisc redaction tecbifiques, sudi as Weirtsi filtering oc spectral 
subtecUon. you car^ ahimx m^bedds^i watermark, as nohe. This m>ise represesus 
th© mm of all ihe •watensmk iayer$. This noise cau be re-scaled and. mibedded ia othex 
id iiasges sucb feat they iiapetsoaate the origiaal mage. 

HowavsTj whm smbeddmgmioth^ noise layer that comists of Iocs!, s^ays 
ajxsutid the lirgssstN ^m^Ybe 5) feature^ ch a*? peak of tte d^vatHo, of ihe imsgs 
thsaftacicsi be toppal lbs dca & m!iaitoUSPatmlsSenal\'nbe''»*M>*5 ii^f^< 
m 1 < '^0 '>r'' xf^t.-'iadhy Po^vel! and Kit/bag ai^d a&sigjitd Di.&nh \ Ji i tiK 

! t i 1 '^o n is I i o b ^ i t tt t uutgc *>ince 

U V ! f <- St t n 1 I 1 ^ I >SU <.i^d tS 

viK UO<i 1 J ^ l^*. V \ i i 113 v,vp% ^'Uadv t3<.0v.\^ ti.u'^CS «o->l 3Kb siduo 

SO I *h oUl 'ifttwj:>e^ A.'scxpircl^^i tb^^vmt.r^fe^U'^e^sa sd, ti3ek«>ssikcH ih«U 

thc> a^ga ba*v'cenilieoM a dne-v^ image This medceoav la ox'vs tiiv m^a^e san 
\ >tiiostt.r la addition, tt.aiuieis such as pe^s o pe&ki> of the denYdtive iO^ >5si to 
ti^o'st era IS > miat'oi hn a1h> s nco tbe$*> iv-atures ocau ^ ithi titc i tin^jc, a ^ obal 
d nab^.-.e ii> «. 1 1 c;q ut«d to detunna e Vvhsre \ht image &|>eci^*ic vvaleirnajk^ Ovt,ur 

2S 1h<.r>.>t-j \ h>. , pn.>hu''mw3d t s^om? L^3h^^ nu 3-"! > \ i s i30 

dekctor b50^^ if ihe anage ba.; been i<jmpcit'd w ihc tu^age an r'd \ ;..c .o<.uL K.orc 
i>\' .--c I -(.f3t-j V , ^ .3s^ ^> . . hu-csv J. vr!i^i.i>('a5~^cr-!i^-^< ih^.'Uv-'^ 
NUt:,ONU.->it tl3ai t! v^itlbv^ot gtoisp ot sioKii F\- '?tqucav>V!5 c^dd i.i.oa a uuc isou 
vcmoa iKaji wiHi earlier vt-riiioj^s, Thg second saggesdon i^ io add a layei of noke 



{hCM 1 UM \ 5s\0\'v 

Si «„h as th<. peak ol the dcnvais tocj bed *i space-kmited data such ahv.** F\ 
equv^e, th& p o\ ds<s ntuu ution aboi t fei? locatio of ^ e pictuis'sf ccsii e aid thv, 
Si^mg l« ad&tiOB, the -^^ hole block steuamt of the watcxmasl, smb P b\ Q f \tl 
src-a*. for emb<jddi ? and Q aro prvfeahlv Use and maltip of coakt 

he bdNC^I aiO« id tljis kaaus IfeN ifcf icate? basod x -itea mxk s id c ^ nodded oata 

f l! « 'o t 0 1 n t ( ^ I v\ » u il 

J u* on i1k £?o th^ e nisixld d sxK.d li Ihc tc«(itiiix i% aear ^ edge &oa c t^mboddcd 

Ih e >abs?dded loc-al ieatuje PK equss ce 11 tr eaJly i rfo n the usreodcr 
ibat the feamre part of ihe phAin^ hy its LWimce i k\.a1 m&tny^ FS ^eqtii^nce 
s!is>uld also m'ude a gnd Uyvt so thai otsce if tomd th<. scaimj cocf&iES^I he 
determmadv Instead of a gnd Ikvst. the watiOTSSTk decoder coi^ld employ the 
atoi i>m1xitio« -ysd cro^ eo atso *?csitag i stfaods tfn con scssaft g t a scaing a d 
i *U oad ^^.u s!_d m ioamt»r»t «h i ai-leatuje sequsncv ^Ijo do 

X ro ■! ! 11 m ^ti\ i k hi K in o v 

sbiM d U ' f d 'h-oagh (he foUoxw*^ two er bod} s.fi{s fitliciist 
enxbt 1 10 >t ado 10 cJ 5 o^u * sj n aae &iid »dr •■tasuilaj «o se «scd ft* 
detmaine di® mmQ&^s nodimz antt rotaaan. 
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S IS n v-oU ^ 5\N a. % u ^ml 0 JiU'-v \\ b > < v. ^\ ' \U\ to bt. \ ial>K <js:u^ 
CO nfxitatson&r for a^uiocorrs^latJor For o<&JBpk, iv"*m^ 5 Ox 1 0 attavx tS^ 
autoconeUtion. mly aecth to mciuac 20 mulnply a.mt add mstractions pm. \ ad to cxtiix 
0,5 toSXchsages, 

Th. sscoBd sRibodimml mdade^ ustJtn^iimg the imdge xsfotmauoii by cro<sj- 
10 <:k>ireiaUng ongmal I*M mss? layer ^-vifh an image wkch previouslv fead the I H aois'' 
b-ViLiriided dbi \ rodti d A^sssmung t1^? nt-aehasoii^ Iscmhueaily 

i is ^ ( 11 IK I \ uoi.^ 1 a i'- tto, dnd tistf 

<. uu t of i1 1, csiimatiOB smee the m^siEiptsoBS are us-ualiy only p^alJy toe. 

M audio applicaijossx the ts^sMoji betweea embeddmg a 0 aad 1 Mt of 
aimbs'-y mimx a oi,cw mi iiedi&te!y dia»^»g the phase of the PN sequence, 
20 x\Ttth fio tj maltiphms fo ~! r$d 1 ami -visa-versa. For example^ ate represerjtmg a 
0 luxih^ hii b> 'iiibnavtsr^ UK5 of shsfsed noj^c ftcsfm the the 1 aiixtliary bit 
iH 1 s ntc t H < the isfea|>ed misQ m th& tmx sigasi s^sspte at^d $o-on tor 1 00 
t m i hi istm } \}d<,0 4f'hcatioiiS. Bdwever, the e>es ajsd em are vex y 
s c n t ( Hi ;s. 
25 U ii the t!',ikoinon ^o'^^^:^i^ i bu oi\i.u>aiuu/ 

ii ^ i. p«HX^ X'i,"^^' ■■iivj ph.;NO .^f :;he n.^is*. ;5s^qUv:roi-; if 



Uj^ f -^^v. I, m I M B 0 < S \ !. o > id J u <1 h IS n V. i ) i ; j > f 
5 ^5«.c*vt tUs. (.,ut.'ii, t f ^ t dp'it jr<.^1u\c cSvi* j -sj u i\<.t r o'lvUie'vi 
If its i e cnbos Ckntros^a, v hitc oojv lm«d^'!^a.te^nJ.lk^ where J^e %ahio c umge5> 
evcr> p xei tfec csxaeia j wt ouly itnoves Jiv aoisc tot aii>o pixxiaets itcotit,<-t aAvtt 
hiXkHG e\siiy p xd iS mdepmdeni m wbitt boi*?c A UiJreat ^suiation to use 
wtee -val ue changes i« blocks of pixels, 
10 An aten<5tivc s»nlut3v*i iiijcjs ai <^ut(x.orrvl<Ujo x based xva<cut}j?il, defmcd <«s 

takj«^ d cops i> « ^ma -"t. knvcnn" iH i ei <^ « i piat m*^ ?J ^huhtH aftset fmm iio: 
ongnalitTxH^ 1 5i ^v. v. t. \ ^ I ^ ^ ->ed to r?-aos,f O'-^ < id H 

V ^\ urp\^ t < n s ^ t a ho > u<. lit fts eseut 

15 t>icoU s ah wiifl iriv.pvdj,^ \\hxt\ ^ r> o\ <.\d h) l osbvidv. 1 ^xci aid ssh ^ot^ 
copy 0E the snaage, 

iliih of XJi-atu mask ^lu-v i\ e«« * tej,ratii?a &i ks?, s& x% j ih ical~>%oi1d da ^ me 
1 oigi botmg \% ill hi. iclaied to t<Acb oU>a and feun? \ c ih<. cainmS al<.gt'aton Tlu 
■v^ Ateinm x^iU al^io he Bi'' 3&\ble -stncc il mtmsicaliy place the dit a whe e t can be 
20 bidden In either uoaK m offs,ei co% > of c maw n alioadv preptwed tn bo hiddof n 
the image* 

rhv |>not-Ait Nho-vvs, tfets. tvpe oi made Kmg used a aidjo, and bi at^ 
t u%i.d< - 3. i iuti a.x I PatcRt -^$,940,1 ^ ' H 1 1 999 ) s K 1 

25 only work' with tnniges in video. Tlais, for ^irigle iniages, if dis whobluiage ss used, 

only onfi bit per cf.nud easih/ be erubedded and reivievsd. 

As shown in Figxire 4s, a process that uses several blocks per image caa be used 

to iocrei?se the Gmheddcii data rafo. The block sizs is a bahuico between tijc mimbor of 

emhoddsd bits versus asioarst of aoise embedd:^ to retneve Oiae Ut In additvon, fee 
3§ smallar the block, sfee, more mformsdon is lost in sslge patterns, Fimllyj the ahiit used 

in embeddiag Oia low levd copy of the lavage shoxM be mimjmsl so as «ot to dsgrade 
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1 IP t s 1 UH u Ik, uvigs'. T« appv,as& do^irabl^^ to ve Uic -^hi ^ 1 iri,Ci t'-^a^^ ^ 

3 Ken l! i T f -^s 5 V OS i. < < D 

} ilU,\\\ >. ] > > V s 5 il Klx»^ oft'-! Dkv\s 

'ovMo tbe cuites or smuiai j><&ctioii oi tbe mu^e tjguto 4b. tht, X biocks cona n 
^>dle'T3urii:{>, aad ihe bbcl^s without X's do not coutaji* walei'mark'? As o»t ta » the; 
5i0B-vvat«nrarkiSj(l block<; pomt to the ccmxr of the imatjc ^ cll as dcterrr i"? 
sotatioa sMoe t3te? m*© asymaietncaL 
10 Duimm( MedM & ^ « ' 

^^*pu>b1em^^5^h<.nf n^m o s >1 o^tcnt ^ixcs $ thatthcyvviil be 
Nt > <- b { ' c dii^^ n jti, ! o i m ) s MymorethaaiO 

s„\t.^ txn? V. n c t li \ a !!) in \ f sxv^d lo olhu 

a-i T->f>t d m-^iiiH)n-> SIM ^ i ^ n-v. V 1 1 f s s m t! ( mt f b ; {b<. i. dv' 

<.oald ml niH her i^onimt doe% i50i pky »mdtsee<.1<? to be re-ctkrvj-»ted, or btvhei >v.c 
aeeds a fctwaKs up^de v^-Ijcis h«r she lus dono Botbusg Oixs ^ Jl coafifee and wpsot 
&8 customsiv 

20 Xii© avjiamse media «omabtog pooess ts lo i-e->om5r5*pt or re-scrsmbie th« 

ontfcM usmg d xicvi- tecteqae or key sa<.h toe t-ontont ts tvndsied (a-s&uming thi- 
di?\ «. & i<» re-'ftntqabk), or mm^ "soms other ^Titea ai, possxbiv rs^ihi or tior i 
^■^i. V r> mviiiijic to t!ic cofsustjoi T« -idditJOB v^hux k>,>'^ ito rot»K lo he. broietj, 
t^v X ov I tk5*U\ irt>?iiihv<.Vi,tem^Mi1h 5M>en >Vv,rbpt. \ Ins <i>> 

w V >i. >tUc us K UtKdoniit uivj ^ '1 h is r i oi o U5 l iV j j> s 
I 0 4 3 nt ks Mi r<x i s t I niiu p spi u 

0 * uu rviWi>Vts ilic < t"^'"*v,oi toi 4»-^ja^i0 on ihx. a^^ej 3 • Uthtiiv, To geiwtait, a i^^xs 1 , 
tbv <,ni.r\pboQ rcRibi^t, ^.haisgcss part or all oi lha prox lous ke> tsi parttv ali* pati of the 
$0 be hm^^d on vmictbistg t mqw to tHc wchme or soth' are tunamg m iue 

oiAchtiio, !>Uv.h a^ apxoce*!^oi: ID oi aitc' ot i jel5as>h vars r«A,vde Hn n uoopeiaiy t. 
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vu I j) i MU'Ju K M<>m file ot: tfee asor'-j ma^ae Ihx isijscdthe«-\t 
time. the. coment is rendered. 
S A NO oclbt rh<*rgvd>jaihL 110 the.' coatcat 3-1 sen i uu \^to ui Ll^ it 

hi, iuh<ai4Kd sfack Ntfe time tliat the coatctit iende ed, \vh«i' e \ is, jjOi11^> pio Uvtci >mtica 
mtcger AHem^ively, the kev ma%' be changed ba&ed m. ^otm tNknia* 8\ t.it tr \ 
such as tic leceipt of a iievv kev tnm a local c?r remole key maaagsnuciit «!>s.t«m ci tbc 
fecv-ipt ot ii ktv i^daty flag isom a key niaa-Agefiient system 01 r^gistiy datao*ai.(^ tliat 
10 immci^ t&i, cjiciyptoTi loutee on ih^ us^r «t dena U> u|idate tlx key »ae ihc 

coBtest IS readsred 

Ps >u^^s V. ^ J jSI it ^UH K ^Jt,* be updated a tim«^ 
^ '^'■il V -^ni, (»M or >m\i-'i < css U-<t. -m.^ v-n 



15 Tmmmarkmg 

Uli I 1 U C I i S 1 Ij 5 n \{ ITiS f. K 

1 5 nsj i \ ru > tht. t isju 1 ~v Us n $rk 151*^^ hv, used k> «. h iv*^ h<. u ?u s.^.* <. u^i \i 
w nn-^kk^h qBeat^ci^alt^slomaUoiijKj'iitsstobec^npatibkwtHthenevi' 
2D signal. 

I e\-aisple, -w! Cii i^fcyii g D\ D audio uvej &xq lad ^k\s f ? d.pU^l jadio, 
%e \^ atennark can be retnevad and re-ambedded &t a bgl level 01 umu** a liLifec u 
icohntone it the btoadcast locatei Vddiuo AXy^ the tva^eitiiark &onh\ tje > »-^dita<^ <it a 
leps* tut s^xit oiv dae to tl e inueastfd noi&t, kvel m sispi-il an audif 

2S i« mor t m tst .^-^ « the ^^atonnark^ whxm ihs orvgxi al DVB can bovt, rVe lows^st 

I <. i ^ s t, a 1 w Je^ iirk m aiiMs^ ooi-'wml r^-?! won'U o inUm 
lUi t\ )X * IK m 

-i5 aio>(>Hi«r sab,<;,cix tjitji' iSJ jtt.iii \| i>ht,a'ion ^eiiJ 

30 00 \s.o I % > axid ai»Mgne>.i to A.d I , f lea on J vvhu h wa,\ 



bai;ed Frov i;^.lvr./-.l Apr.:ic:.i:oiL-. Se;-.-,; \':!ai:>as 60/101,851 arid 60/110,683 iikd 
by Kers I.svy on 9/25 S'S as-!] i 2C.S':\ !\.-spe-:ri\- aM mdiMhd herein by reference. 
I'hesg [yaUiit applications dsscossed. cbimgi^g tlw waiemiark type wh«j?i audio was 
co'ivsned iVovn raw PCIM forsBas; in a comprcAScxI, such as ivlP3, AA(?, Real Liqaid or 
5. other saBilarfoimat. 

This method also applies to video signals. For ex&«>|?ie, whm watert^aj-ked 
DVi"> video is ttsnsfex<sd to losv baadwidtb Mtenet video> mch as pK>vidsd by Real 
Networks, tbe D¥I3 watemiark is read and iactsased is araplitods or i-e-embedded m 
SUTOV8 tfce massive cojaptession ^leedsd to stre^u video over low Mndvvid&. Tiiis 

1 0 wstemanfe mny he used .for wpy pmmetsfm<, hm eoaid aiso be used to embk ibsks or 
kforaatioa abo«t the Yi^0O> 

hi some applications, it may be useM to convert auxiliary itifoimauon 
embedded in a media sigrvsl from one fomuit to another. Tbis com-erting process is 
anoiher applicadoo of trasismarkiiig. Tran^markit^g may inciode conyening ass out of 

15 banO idcatiilsr hke a tag in a. headeiyiboter to a xvaiermark or vice vexsa. it inay also 
its volve coBvertiBg a message iuone watemsask format to asioiber. The process 
involves a decoding operating on an. njpst media object, and an sacoding of tlie 
decoded iatbrmation into the media objmt ,lt may also iayolve a process for removmg 
tbe mark originally in ths inpnt object to avoid ititerfe^eewiSr tbe aewiy insetted 

20 mark; 

There &t& a variety of r^mom to perform traos^arkbrg. One to mafee the 
enjbeddet! inforaiatiQn more robust to the types of processing that the media object is 
liksly to exicout^ter, sucb as convettiBg &om one watem^ark used in packaged media to 
aiwther \valerm;?rk used ivj co^np5^^ssed5 arsd electToiucally distribi5l?;d, media, or a 
^^5 ■watcroirirk \-,<,ea iri racl'iG or \^'ir;vl':;:s pViOnc bro:.-!u;a.st rcarL^^inissioji appiicfuions, 

n\N^ > , 'JOS * - !b^ s'H i^w^'i-- V < ^ "■^ 0;' j lob >h o<^k> ^ a'v 
be encoded at ti^e time of packaging tlse cosueni for distr-ibation, either iij aji elecirouic 
disiribwdon .feraiat or a pi^ysieal pa{.4'agcii ? ■ it:4imv , mch as m 0p6c8i disk or aiagjretlc 
30 m^rsory devito. At soxjk pomt, ihc media signal may be converted irom one format to 
brother. This Rmnat conversion stage is an opportunity to perform traUsSmarfcing that is 



tuilored ibr the n^w tlmsm* m !crn\s of iobu^ looss pcrov-ptlbility concerns. The x^sw 

broadcast, in tiiis case, the idcaufier nitiy be iransUK^rkcd into a watcsDiark or oO\e.r 
liKiudiita formal {hnl is tobusl for b-oadcast spphcuiiciiB, The new rbrroat raa >■' be a 
S compressed (lie ibrn-jp.t (e.g., ripp.uig from 3b opuc;u disk to an .MPS fonnal). Ir= th.ls 
case, the identifier may be traasmarked mto a file ^seador/foo^er or watenaark fomiat 
tJiat is tohmt md mmpmihlsi -with tlie compressed ilk iemiat 

The trassmarkmg process mw ^^"^^ ^ axktmg miheMod idmtiMsa: m. tact and 
la>«r «dditio£5iii id^Mer iato Media c^ject TMs Btay include eiiafdmgs 

10 watemiailc ttot does mi intmi&ps with aa exisliag wat^amark (e.g., i&mt the new 
watenxjark in Tmmarfced portioiis oX'the media oI>|ect or m a BOB-int«r&«Bg trajisiom 
do,maisT.V u m>^y also inchxle addiag additioBai ormew identifier tags to tedos otr 
footers m mc ilie SoxjnaL 

Fig, 5 iB a ties', diasrtvsra i;ia;Nn.Ub!;„^ ap(x>c«»s of trasiSinarkjsii:, Fh::- ir.pal to tiie 

15 iransTj'i.^rkiag process is s digit^dly wat.omi45rked signtfi 20, sue;; .-ia an .-usdie siiMud (e.g., 
a music track), a video signaJ, or still hmge. The dlgitd waler-nurk carr-es a »;.cs^age 
payload of oae or .more symbols (e.g., hitmy or M-ary syaxbols) conveying information 
siKjh as a content idrntifer, transaotkm identiSejE, dat^ase iadex^ usage or eopy controi 
parataete (flags mstnictmg a devise or proeess not to copy^ copy onoe, .not to ti'aasifer^ 

20 etc.). There arc a variety of applications tor digital wateratiarks in mttMmedia content, 
melttdlag .tbresmc: tt^ickmg, broadca coattol, aad Bsing the 

wstem^atk ^ a itigger for or link S:o .iBieractive mnteat to. be rendered aloftg m{h ihc 
svr>.€.m:dirkcd slgrisK eiti-ser in re.spo»se to user itjpm or aotomsiically as the 
%vatennai-ked signal i$ playing,. Some of ihese applica-tions are discijssed in co pendi.ag 

25 patent appsa;atis.!ns (^'571^22. 09/563,664, md 09/574,726, and 0.9/597^0.9 v^'lsichare 
Iscfchy incorporatCi.s by rcfcicrjoc, 

.In tiiosse ..ifpb. <- ,aa-,. ; e; i a - '.---ae- c ^ ..so.k -.T.a^.ijuaik the w.ttOii:uuk, 
signal einbeddoi in a Ixost :>ignai, Si>niO cxamp-ea inckKie; to incre3.^-i; f.ii.e r<.?b;.5;U:i5.;ss 
of the waterriiiuk iis It undergoes a foiinat change fs^-sch as for coiupTCis.iou., 

30 transmission., digital m au;dog convei-siou, n.p~samp.li.n.g or dowii-sfanpiiug, prixst5.ng, 
display, etc), to t«dnce the perceptibility of tlie watermark betbrc playback, or to 
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M„U Mo 4 'K - ^ ! ! ^ f n >J V. *^ 'i; o a O »t J 

\^ <..!<,5!n"^\ « the vi ,t cnraiv^o ■suuai U~> \ \\<tiuu\uk a ui t ! -> < > ■> ) ^% m u\ 
5 uv o kkuurs ihcpivseiveof 'i^'tatc>rr(Aa The spusific opt. an^n 

4cp«Kl'5 on the watennafkiiig process employed Iti manv t^jcmqncsj, tre >\ at« wnk 
ks-y ispccdM &e sp^ttial, tiiise, and/or iVequeac> doma« location of tl>e \\<«eiir;<3ik 
stgxid It may al^o apecjfv' how to decode a message thai bee» modtskit^i wjtli s 
pssado'^raudom awmtser («<g., fi-equeuey or pMse hoppmg, sptsatf spsscemm 
W modtilatioa) To siji«pls ty tiie search for the watmaaik, the \% atemtiik Uetcctor 
!!icarclic& for reference signal atursbiit??^ o^'the enib :;ddsd *uch v.iown 

isioqaeKCCot eitibake 1 ; Uom s m j u < t ok p'ce 

V lit I lk^ 1 5 ^ --u^pei^t -5s:jjaj sad to dctonm»o its poijitOiWi itius ib«f tuu<„ 

NVx*-. wateim<4iL ifetector m&y optio«aily decodo < n cmbcci:?i^a r.^c&fcigc 
(26\ ^jucli as copy coBOTlpju^jmeissps, coBXsjit udentitkrs, om\u idmvif\<d\i^ ^jotissactsoii 
identtiimv cio This^ sstep 5« opf bccauise the ^mtiai dtitection op<OTUoa may &.>n.vey 
ettowgb: miormation to tagger the remainder of ths trajismarksng opmtiOiL For 
20 example, the tmi^ dt'temois o'^tie presmee of a ^ mmxm'k sigiiil a paftjadt^t t^nv 
Bp'AC&i or trai>&lbmi doaiain location iway covsvey &m ot laote bits of message 
ijifom-jatiOs, 

'^o^^v•i?xa^nplc^!^^ II help Uii*?*ci.itctl^cdotC5Ct'otiafld m-^-v^.^ <,cro(,. njjpioocs^ 
l> K tvp^- i4 VI ' uiaxk entbtdd "iS pjo;.e&.3 o«cwit<s ^\nihol ■> > a i~ nc^soJ 
25 <^ijhi V ! < i Ui^o'i st>U io<^Tsi u> !Dv «1 r V li. n-'-^u i sno i m-^ 

co.a racsssajic s> va1«cs In the ^^:c^csv >. .-^i abvnx c o>l t c gI-^ % u -> o i ot 
\ e~js oi> a particBl^ shifi lelatsi^ e to the host, ^nd''or bv the amoimi of change 
30 cflVckAi to s\ staUsacal charaoiei i<;{tc of t!ic host by ih< itmh^idm^ of iht <^hiiwi 
\ C5.&10S* tx po ot uaboddmg oioocss embeds a x% &icnn^: k b> roodalauug 



V, J i ^ ^ I n s ' ' i 1 o> K * r V ( £. , 

^ . 5, "-^^ J ' \ v^^v ti IMS XtAO 

•values. 

.M thsm esabMdisg tectoqiies, ih& 6&imt&s IooIsb fm attributes oi the 
wateimark ssigxial, such ss b> using oonclaiaon or a siaUstical analysts to detect the 
!»}u:fttid versio^is oi modulatcil samplcs/cocfRcieafe By xdctitifvjng ovideucc of kno-v^tj 
Svi^bolt-os ^(itermaL Signal a^tJLib^^^s■5, thedetcUCfti us;tou««K'5 V'hHh^. a%\ac"aiik 

Hjc { tis.no ^. ! ^ ( u u u ^ i>? ^ s 

iK%-iigc >(-'^V>Is 1 unht {^'■'•o? toi'-u JHt tJ^i^oAni., iT > cnq !0\fcU ^ K s 

Ns-x^ m^e uan^aikisg proc^^s jemo^es. the lust wttm^JOjV V^asn 
this proces is opfeonal becau e &e U jjjsmarkuig piocessS lUjiv proceed b\ «mb$?ddtag a 
sssconii ifi^aiermark. %'vnhout '5p*xtlicaL!> attemptmg to remove oir mitigatt the «ifY(jct& of 
e "St t,>noe the watcmtark- detecmr ha<5 detected the xvatcmiark md dcietnimsxl is 
temporal* spatial, m^ot fcequeiioy aomam position, it em mmmc tfe.o watmBs^k or 
t ttt.)=,a <^ Its cfiat It can sabsfeJutiaOy kuiox c the >5 atemark m esses v^hno th^ 

I >. to(m n-"5'X"''v'^ofti\t.cmbeddoYfiTOvt5or)«itu b \i \ <f\^\\ 

h\HT-^.*4iT^oh his coakl oUow i tihlt \\atcT5« irk Ui \ .uh'L<.y o 

contout that is gomg irom a low qualitv mediimi to a tugha quality me$liims Although 
tbs i.o«tot5i &t'1l H (.jtialuy ot the otisjnal memUiii itu vvat^jim-jsik-wilf prcducu 



I IboseapplHiU rs u tM^vw^^. t,tK in tbs«ew fojnu* i {or 

vi, a*tfij»arki'jfe In taij> c^'?Os the t3anim<j{ki£?g ptocess pj?»cced)9 1 > «xnbo.^d3ii^ a HOC>>nvi 
w ak5{ ma'-k mio the ho'^ sjgaal artej ilie fomut change. ha& <x-c omxi T hi*^ ciuHl'^ t 
watsrasaik eiubcvldingprocssai* to ^^mt the w.it<rrmark to tiic perceptual auaiitv a^d 
loMijjtBsjsv paramcteib of the sipi?i m the sav foimat la othei applications!, ts^ 
to \%bu<i the «itgu^ j& btoadcasi, u j& dtttJoi'Ji or aot ptaciii.all> po«^.sibl.e imv-^ept the 
<npijfes embakUiigatiewwsieTn-jrls «J>crtb* form itiban?? F'^t vXoj-vi-^ 

thcfounatdiasigemayocei' hi h 

(O n{ !. « T ' c ^ns ^ t 5hi-v pa wMX\.rH Afprx*pndtt h^i the ^.e^\ iormat oi 

15 me sjai^si osrore toe Toratat cmmge occurs. 

S5.<333.e or &.omt vli^fu ent cnibeddrng proce&s m the fit%t w.. t^-rmark r< >> I hxh scck-^ui 
^vatemtsik cm be addctl bete the tiausfenaatton, ster kbs ranisfomisititoij, »»r diumg 

tram&mistioii mfe a feeabsck loop. P or exampie^ t&e first wstmtisrk may be 
sjsbsiided bv adduig a siufted version ot tlic bcsst si^^l, wMe tbc '>uoBd watemitfk 
ma> be eaibedded hy ,iMxn$ apea,«ptuja!!> ads^tevi p^eudo tn^dom i.a'^v«.r signal m the 
puvsnMiial <.ir ^ ^ tie traafeform doTnain (hie Foiiner, OCT, % avela etv % m \ ttc x cr^-a 

tUiv.*.' „ I a'itc^jj&i <?T thv av*. w (,tCHiSv.£k<<iu<. f vi.'l § s <w / u^fv 1 
25 Hv. p ! J i a k Mir w n i x<N n i wii 

H^ba-^tj)<.ss pa» <W)i«ie-is ( ^2) (e g , % airnnaxl hi^ml gaiiL f^i&m ofjedundancv, 
lto4Uk.ao> doftua> lota'ioiia tiuUp<ii*icuUjlvad5pt ih-s n'a.cy:tt io5 &**rvs"va1 uitbc 
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Ticw toxmsi Tbt? second x% ztcm m k laaj add new iuSm jr anen .vhoi 5 
t' < n<;fotx« ^U^ 1 ' %^ 'la^j Jl 0 > a tojinan* <n < .jui be i <vcd fot >' ^i s s t x n In 

mto the first wateiiaaik m4 does* not alter its meaning, b»t mstoad, dd4j> ac*d.uoi><l 
payload mtommtJOB- 

l3o ensure that the second watermark satisfies robustness (sonstvasat^, the 
ensbedditig pixscess optionaBy applies a feedback path: tet ^pliss tite watemisrkssd 
sig ial to a degradattion process, ihm n ca$i re<5 tV 11 n hot of sjuoi-i. niun m 
0cct>4^ng akriovi'B tntasag?^^ ^dsUu^* •> s uKrv Llv » 5 oi x\ it^ d irk s -^nl 
'n ih<i r>,-yaiOi i, {kwpm 1 spatial o j! v^ro'isi 'i i 5I ^ t tbc.'^rrots 
OJiUfUJ K <lv Kivitjoa o'-* < .KM s ' , hid - Ci" f,> ^..n tV-,..'.! n <; 
opc.vitHX-i iiat nivSiLK ».ki.y.ida!:{ox{ iik<i\ to ht: uiooimfeset^ m Jic rus ^ 'U^j .t, »ucrh as 
djgital u> analojs vionvomon, prmtmg^^ammg, br»<Hlc^'3^* narv n,>s<?i!->n, m>w ^c^^'c 
c'laagfs, etc< IThs piocm iepcats until ^ ms&smsd ertwr latc talis bciaw an 
accepts^le tlifesliold. 

In additsoiJi ifce embedding process uses peaiceptual qijabty parsmetet^ 33 tha|- 
^|>ec>3fy corssti Atnt« v n pcrcepta'*! qus^htv tk^e w^m] fo" th«» new fentt^t Thoi^e 
patantsteys mav^ speettY limits on tfee wstenBark strengtfe> ox deise a perceptsbiiity 
thjcsliold tint can be mcasuxed antoiaaticaliy like PcsL Signal to Noinv R?tio t>ptca!|y 

I ip>.dv^>jaordifV^^'i\\tnem^iTiT«"TncUiods Asani, a ib<f Uv(. >r^d!s ; 
pux<-.s pi^a^-l iOvin(*cs<i it?fdl\H'kpitl>t\inie iMK stb ou\ pi \l i n 'fhs 

tiiij X jU-< i' ^ 

S U' "^j^mpiK ills d^p'i-KtHi. 5DtuAt.t>Ox Ivm^tn b>. w d(.rn rk t 5tdd» g 
^noc<^N 30 on &e one band, a^id tlio lenderaig^editsng mitoinnen* or traflsir.i,sioa 
otnimurnci^lb ("4 '^'>) oa die oibei Tln& dugf.im aepjcts how thv. embtKiki adapts tiie 
n^-w \i, stomi xk to tHc cn\ ironntt^m m nbu ^i«!»n -likcd si^-<al ho a<jxd For 




in'jagc pr(.>c;i8sing 



then i.1u;- trar;>ir-;irl-aai; pjoce^.s embeds the signal %vxih d now x\ ;:ie;;nark ue.^iyted to 
5 suivKe liisi process aodbe recoverat>le via &a image .scavme-d from thepnT.U.cO image. 
In this case, U>.e watermark eiube^lder may mclude additioasl calibration sigaal 
ijsifbrmatioa as set fotth m US Patent 5,862,260 to saisuf e feat the wstetmark can be 
deiscted dsspii^geometjic distortion. 



W eaviroimjent, tlie operadam in tbe sditiag tool cati be modified m as to to^rove the 
sun'ivabiiity of the waterniark. fo this cms, the Image editing operaliotts such as 
bkUTSBg- color tra-osibrmatiyii, etc, are adispted k> prefer/?; the s^j.-sial ti; the 

extern py&, ibk, irs particalat. 1<as p;;sj' ilHe-y or blur upcfalion thsi lypivully rcjluces. 
high frcquc?5CY ci nnponcfUs oui>- bo ;inplo;«eT.5ted so as to pas;^ selected high frequency 

1.5 compoTJeots to niainuun ihe ^vatennark sign&l ift tliosc coBipo)K.nt^. Tl'se operation of 
acldijxg gaassiari noise may be modified by shapitig or itdtKiog the aoise at certain 
ii-equencies to i-ediice mterfenfnce with the wat:s^majk dgsia!, at those fj>3qumcso3, .M 
cssi^ where watexiarks are mserta! by issodifying a p8?iieukr color eha«nel saeh as 
.l«HK3tjaBC$, the coior tmts&ms opemtioBsmsyhe desigited to preserve the tota^sce: 

2§ of tJj e waienuarked i«iage. 

FtistJisr, tte si^ial sditijeg tool maybe iBtei^sted with tlie tratssmarkittg process 
to decode the watemwk before an. operation, aad Itert re~eocode tke watsnuark after 
an operation to fcosrirc thai it is preserved. For exan^pk, tlie watsrasiark tnay be re- 
applied after the ixnage editing tool is u&ed to ma^'e ati s.fime tj'an&fbari of e^-s image, or 

35 afler me .image is eroppe<f 

In d-ecase of f<.ui> ^ Ns o . ill < Ju ^5v>n' v.Av5 v.* . . > 2! cnofi dianncL Uie 
^v■utenlJ;aru■ rnay be tiVT so i.< « r--' ' ' > <. <. -^-jo m ' ,i 'f i J-a r>>vherethe 
s;gruU(«adjo, v5deOstTirjtii^goss««K^^^^'*'"^*^' 5-'*- - . ;^hi k r.^v %vhcre dis." 
aigival is un-compressed and re-Ot>i-)iprc^s<. d m *. (-'c rojt^ dsv. e .u-^ signal. is 

30 irau&fonned in a router <y\ repciitcr ben me sig^.il ar)pb^K^^ in a router or 

repeater node iu the co«ununicatiOst ^i>at3is Uic watertn^k ir^^markod at higlter 



As m a^di^s jii^t ^ the second watemisrk may be aj&pted to the iateuded 



Oist^ i s t ^ i \ nil JKt i h 

\ ^\ \ \ i I u * \ (1 k 5s >i t 

In a.n<lio .«na \ ^dco oompr^sston codecs itie lra^3i.m^irk5i5^ pux m is be 
jfttvgi at<;d mto the compras^ioa codec 1 hxB m^bKu tbe couec to modii^ fee 
coxnpj-ii^Maa operation or mo<lii> the bitate to en<i.ure tlidt the Wditemi-ark &u{ vj\ ^.s lu 
the Btsi Csiss, tfee coj>5p*cssion codec may be desjgiia! to p^c^n'£^ ceria«p *ic»|i enc\ 
10 eomponsnts tht t 'vtoiil*^ otherms*? t>& iubsstjataally i eductd to p?«ssi^c flie 

tiie li'tt«r c^e, tt^c t<ua*x sek><"is a bit ' a«e "1 \s h'cb th ^ w i hux \ '-s -^t, \ 

t I ^ \ U! -s r i I J !, ! ! s ^ in } t 

MjfiWi ^08\$ to xv*.iuhiCu na1ov!.t.' talditfdc'ijcc, such^apvJ«;o <3Iccj pv 
thv fce^uud 'ft dttriBtuk caii b <,mbedded so tb£«t it is. mor« mbii^st ^ hiiQ «*<i>mj; v sfa u 
iijc pu ccptimi qmlitv pistamctm of the tviudenng <kvii,^ In addition, the w^ienn^k 
cm bs chdBgcd if T>V0 msdio jmstei* ars converted to 1, 0s or c-assctts tapes. 
;20 It ihe waMmakfd si»jijal i<; g>ims, to K ti<3B<!mrtied §«ch -^s* m ffa? hmsdt-4«st 

o»¥iioameat, Sxeemboddmg process eacod^s the seeoM watermark mtfembtistaess to 

25 ^tt' \\) ■> i orn l u !u ''\ ( s \ V I )v x (Xtt i j i. \ A 
11 n i MO k > s ^s, us t n b ! * u ^ < 

K <,i^o^ at I <^ itsic b-" \d cn4 q\ nouK xn Uic > oxncRt t^-^'-U. < ntKn d I Ik < >!> ^ s 
mav be a tjetwotk address, oi mtesacUvc content like an IP adtia.ss or I JRl , o^ an imisx 
30 to a Beiwofk asfefesj Inter acfiye eoRtetit Eke HTML, dr XML, et<5. 



.22- 

5 1 I K J^U't-ak ihsSvLtoJ »V ik «k J )|0 ^a^} )5 U 

addition, the message decoded irons the Ui!»t v**,$temiar\* such ajs an itkahticts 40, cop\ 
(imimlpmmk&%&m 42. &m mib&Msd. 

fhe re<^lt of tbs irans'n^rk-mg process, m a t>ptcs! c;^^<. , is a ncvv attrmar&cv.l 
16 signal 46 A.s sioteJ, &e liiioiiaatjoii or fisictioa ot tho ■wateiBiaiic max Se trans «Kked 
to QUi-iif hmd data like & hoad^sr oi fuotex, s>u.c1j as <iiii ID3 tag m MPS audio 
Con-vci V, oui-0f-b<ind dftta Jx, tmti&maT^ed tuto m bsuid daU that ib eiitbedd^sd 
mm tiie host sigjial mmg a digital watemiarkmg prossss. 

Watemaiic BmiHtdillng Functions in R&ndermg OescripUon Fifes 

15 Dov OBivSl dsid otlicj msjdia object «ciieiat!oo &>oK c«.< i luik '^o iticaN,. i 

better handle v^^itcsmiatlK » u'n iumTtiem, a wstomi^ hts >. io~^ 
10 £ , FOiftScupt liice oou^iaandl oau be pm% idcd m the tools I hi$ luactioa is csl ted 
'.vufi pamnefeth <fsecifyiTig tha duvired featuj of the vv^i^jiaik mfojmation, g . 
p i-vload, AJbiistnests 1o ?i m^ks to be used. At rcnderstig time, sucii as f*>r o?i-!!icjc<.xt 
25 -viE-^^. mu, pt3iit3ti£> j'^roofk i>\ tipping the ^m-A versjoti, :h<, watetiu^k xUrtaally -iddcd as 

J ^.>.c ^«<^j ?s "'iv. vixjd 4>pii>ptiu <.tduis Us iiKUi.nj i'-.oi-iiv ^ ,t*i 

( 3 )■> ^ i s f i. i c -fi.r Uope-'iKJ- .'V V kM \<- 

>.nH)ct icu tu\ct.*oi t^n art Mo^covci the col>-^i i r \^ ' pp s - „ 

30 may he tM hest eautv to add the watetuxsfk. 



ThMihK hko^si oovmJn 0 cia3i> ^iV!X3r-4t?Ntci viat;o«av.lc'K^- 

J \ i.< Pon ^cnpt-bkc fkxftoa to s rxbca & \v^iuma;k »s iiiithcr dcia^kci u 

A variety of loots are eiuMst-lto submn images to the sssvcr ^itfe ^nfor>^alw n gliding 
ihe ds?«ncfj paran ct<-rs of the -ft atermaii. The sotvei fca reimas tiic um<;c to tbc 
appbeatioB, In fhss way, the tedea of mtegratioii VittuaJly ehmmatsd aad the 
10 regisiration aBdimrkiug xsk& places aimultaKeoosiv. 

Wfeea wateimaifemg gmpbc art matsaiai^ suc^i as packaging^ it is desuaolc to 
V 0 ?^>c e*apMo desjgaer, raU^er xhMi tl e pjtmtef, embed the <?csis eJ wtcia.o.L lor i% 
psDjOU or compaiiy creatij^g the packing- Tlaving ihe graphic arnst sffibed ihe 
waierroark i.s jidvatUp.gcoui. because.' iss-- -.,cM>\mof ;n rihvsd>' roa-riosuicaung whix the 
15 an!^;r, .md the customer itjay j^cvei- ro c<; ;<s co!uuv,.o-c;v,o witli ihe priiitcr. Usually 
ptauci-s ai-c only u<:cd<;d lo ptooCthc pl^r.oi^ oi yT^!^^5ypc h'i addMoB, pmteis dos't 
Vv'ant sjilrd dun.^s to rt;tn5;n>ber, prialiiig is hard etsoagh, 

However, much graphic art nuiferial remains as Hae-an (also known as vecksr 
gr^-hle^) imiil bdug rasteiised &mmg ihe pvintrng piwess^ and the slate of the ast fox 
M wat«miarMagismterbassei> 

A soltitian istombsd wateHsark lasscfeis in tfce Ime-ast file, ma rm\m 
fashion to how fo»ts axe described witii a B&dnt cm e IJbc wstej mark &fictio« 
comauB the bits to embed as well as rul^ bow to es.ub«d tliesc ^ d^ 
elsmeMsS, Tl^a xvateT?« ark fi^nctiot? cotdd be considered as t ^ ^ m\ n p v>pu ar 
2S expatK-cd postscxipt (EPS) tonBiit. 

F^">r ex:ufipk', when producins^ aVid a'vvdtLU t-< ^ihvn^d m '/,e 

hOxi.-c^anfu f - both, ofeurh loUor. A:le!nd;i^ c^ly, tho a*, n rk<. f i ^ v* v> .\x 1 k M-v 
.ht/dnf, i>rn'H-:(niogmin-jp-^. ^\/mch;nx' "oCiMriail^ h<t <. jn i i '■i d ^ tk^ ne 
30 eflgcs of th<' ktJm. bnportaiitly. auy data enubeddii § ivctb^^d <^d.\ he Uo^xi aw Oc to 
tlis biis 8j?d mies* of Ihe watermai-k iuncHon, Simila iv, v,heB pjothicyg drawhig 



s I ■>■)'•! k I'os' £0« Hv. i^nki o f \h ihi s u ' npss 

5 t o> 5 \"k n i is p t a t V. u li-^-^ 

(.5 «. s s \ t 1 I < n U O HH i )i 1 I u s t 

4cs.0'xti»^ the dcss oJ mbec* ft* g mefi od whca lu c ait ss vadtjied, <:av,* <fe it t? 

Ab TJoted tho v\al«TOinrkmg lunccson. mav be ai^pked ux vauet\ oi t^it«» of 
10 acedia obiects md leadcrm^ descuptso i Uni^uagcs F g"? 6 im4 7 Ihi&irato a 
fi-aawwork im m \ lemt. tu g aM e tk. sivssrk ctubed^toa ftau-tioi as 4 

IS LO m<-rti*< c \s t'> i J f ! fi I i 1 1 b 5U 

\t h to^ 1 1 ! ( ^ ^ n ^ \tcmasl 

^.UKc't.ln (, iit'i « f as oc Kdpttnu vs * ? 5 c i k •'tn;ndaiUi4 div 

hv, mcds< objea according to the ^t<,rmark ombcddtu^ < omm^nd \ h, \vatcm\^ 
20 WTtimsBdp^iaa stoismciudcaco bmatio ofpaiamtetcrsdessc bx gthcmateuutsk 
e^^fesgo payio'd, tbo wat« nft protocol fev -vv 'iter rx^ik en fccdd ng «dsoa, tnt 
payload speoificaaoa, embedding loestioas, the tob«stoess parameeejs. md toe 
r)t,n.t?i>hia1 quabty j^rsmete. A^y cojnbimhoa of thws< and othia« pa a leie s « av he 
lised aq>e33dmg o» the i^pplictea, 

25 t. (HO <.i.vT5pUSt. sot) m rsHl i ^ X-> > 

siS .a i WS n ^ f c i i M 

« <.<iUX-*lp ' <. -i v,nd^{ I ffi\T U ^ 

« tjeutiSTis f tho 1 ds I o"^ V. f o\ Tier, ot tiaasactiOsi<5 ot tht, 5 bject (usej ID^ 
30 msetoe E>, stomas device ill etc.). 

* ath^o x^ddd^x, est)!. orjx,u*vd i'l niXxo \ ptOiitt ui , ->iVs 



--as - 

» s i , <. .a 

* '-^l \!0 <- Of i"! b5v>enn\ u> lOtb o'k; i < 

5 m xespoMe to watermark ietectsoB, etc, 

Ihc natem a k pix>iou>l 'vpsic tle^s bow the watsi i aik ms^ss&a^tf lo bv 
e ibedded ajid the muiumg of the various iil ols tltc watem a k me sdg^^ Iho 
jn Otoe ol mA> lie sp^ t Uoa a or*? or aiore paramcta These proiocol p< tit xctu-s, 
iMc ^ paiaa ets,? that speo?t^es the e«-^bed<l ag ^ ethod, sucl as a pc*i itCx vv3 a 
10 c nbedda modxilt, or piii^j. w> i ? 'Ik t^^-admJig d<-v Cv. to t.tn.bed Lk 

ho-,b\ <du5<>tinf <>5rip5c->(M tA f ux^khU n-^rsii.s*.' •issut.ute s v n 
IS smho1& lo cmHe4dov.? haliioiie modatom meihod rsdltYo* e do - ui')t„% 

sc enordifftisysftthitjiholdsjaoidu'iitei *vi/v,sm 'v^idtli 

ieHS|soM or Ireqtieacy domssa spread sp^trimit watermark ^fes^sr. a watermark 
< rabcddn that s icodes sv labols b> ad|t jji i g saa pies o katees Xk qu^tixation levcK 
20 ds^i 1 1 tv-d wUb s% mt)oiv> to »o vsi Jsedded a wmcnaatk «jrib«ddcr tliat eacode 4 
col o ( 0 > o n -^s v.! toue& or t me fiequeuc> shitted vemoii& of the hohi stfi al 

^lonh t s tj-\ K t'^baidul dc. Li some casest«ihc, method mavb^j ktt 
d i^^i. nid 0 i ) i ^ wo ch^m d tiayopt n/stbc 

25 ukUt i' . jJim . ,< o iot k1 i^i X Mi ) r 

w ata mask pavload, iianidv a pa> load spetiBv^tiou The 'jd.jload &pe^ifi(,atiOft mii)- 
30 m hides ilomt. snob tbe t^po o* t »^or coj ieen3-<g codi *o enplo> » tbc tvpo o+ cnui 



di.'e-5 11 1 . > or/'o^ ;l» rnjob^*- ofn^esi^agc spuboK; (e.g., biniii\ bus) iatliiS pajloa^,!, 
t c ' \ V 5 0 1 ' \ > ) ^ ^c^-^ p5 mr :he p'ivloxU t ^tc 

5 .\n 'ur.tv.v^ to. hp<n~s.il u-^ror>'<K ,io<.it! ?rs\>ur divr-j^^ ii\MU<^r'^ v.r/i\vi ^'v 

svafcrsstarb ni tho host iiK'dia ^.igml. The trsUisioma doniam locaUou* sc&s ti^ U<ris-tVsnB 
domaisi coeffidcnts or sefe of coefficksts hi patticulat block ske of coulOTt. E>{8R-ipics 
of IramftjrHJ domains mahnle Foun«r domain, wavelet domam, DCT, etc. 
cmbe4dis3g locations may specify. Ibr exaaiiJlc, that thQ walmmi: is to be coafijied to 
10 C'&ctmi t^umcy ras^^es m tiie ss^l. Also, for im&$&s md yiiko, iha tsmbsjddbg 
ioe&tioji may also sp<xify tlie color plase or planes m wfeicli to embed, tbo ^■aleni\urk 
mgsssL such as ihn luminance chaimel, the bl«e cbamiel, or soxVie other colo" chitsmoL 
to sonie appl^c^lkm- tlte watcnuaik etifjbcdder will embed dUK^eni message 
p.i\lo£id.- m d{Ocr<^ut \i< .\ > i.o p<^T ucquuicyjlramfonn iU^r;. -to-^v-^rs'S of 

1o£;atii,»n, ijn«,u.5jt\, kaxa ty (ur hngik s^dic maik?>, robn«ucs? paramot^n, perceptual 
qaaliiy parametcts. redojKinncv. cto, Ifeis enxibles the watemiark cmbsddcr mod^ue ipx 
modules^ to cmbod combmatlons of dif&rem robisst watentiaiks. rob^xst aiid fragile 
20 wateraiaite or fragile watermarks at varymg ii«^-ees of fsa^lity, & some cas^ss, Uie 
message payioad may be a^mgle bitv whieh xeduoss to the presence or absence of a 
wafeitrsajfk sigBaf . This vsisgfe hit may be spread in a sigaal covering seysral 
etnhcddisg 1ocnt{ot3s. repeated in several instmic^ of 0xe saixic slgt^al, or some 
coBibmaiba of bodv, 

25 A- tx^ied -orcvit 0!?!y, dit- ^.'I'nocddmg iocat^n"'^ wsy be t c;*!cd -cms of 

Npv^-io.K ;cusJHn3i o: tja ^n*1\v\ cosnau> si^a^^ks tL»i .^rt-crv the <.ti<,<k^ to ^;)U)5xLb:\i; the 

5ho pavSoa I fi'si 'oc .n, tb^- ?ob53M7>e>ii ?5t ih -a kv.sM ^! ixl ti r j^^rroi.pk:aj inu'ity 
30 that loradon The ma^i may be designed bv tbe creator oi the i^^wus object :o 



is ^ 1 T i -iv. ic 5 the v\ Ufc^^i aiJ<^^l''0'0 

fa h \ ! rnu s y i iw ii.i^\\bK v,nx%1 bct.i^ ILl 

tb xini. N '^{kI f ivi >U} 'U lalttv {"a da t, >^ x 1 h ^ 

5 watcnjisuk aw perccptibihtj 11k i«>bii*5tu!e&s paxamots?i> smy be '^pcci&d m »s> of 

g , the sxtent to vvksth ihs me?^A^» p<i>ioad i rcdimd'mUv ^.itroded acri>>»s 
^^tbeddJEg iocatinm to mciease its lobastocss) aiid tisqxac^ bcatioQN (.e g ihs? 
K.Kimt to >ishiwh tlxc \^atura«i3l s^jgail is concentraled m lower oi-vas. ilm ar^ 

If) i\n>- 'v'vtosan u rn to ^ ■> ihv, i o*^ fexgual) ^ a h parnwiers 
ot I h<, » iU*;d r ^ 0 vH d togc i txMt the embtd4 \j n <?) o 0{ tmus me 
\\ \h L t iiX iorpcrcepubihts wlis:^tnessi« ispeuited robu&.tSivi»j andjsefcs^tib 1s.t\ 

15 ta\o 'jp \. t> lit. i.\v.ici at> v.tio\'««<u5i'^tK aioi c nib*- t isi? tleai 1 i 

L avet at %\ aAt-rmark deuxiisg, the pr«s&«!!£ice of Ih^ tragi 1e w aUi ffias^k o\ ra^,. ->orvf< 

orby tbre^ioM levels of detected watermark strej^fe). m& us«d to detect tampensitg or 
20 pi-ocessmg ok the wsiermajked 8i^al. 

Tks t-^^e of tobiistosss sadps^^tol quahty speeifisatJ^n mablss t!i© 
vcti^t\jl a»b«?ddex n^odii^e to pvttoxm itei^ve embci.dus> %vtth a kecbick pa% to 

an I lad tUiioaod(,siic\v tm^Oxi otttiu ni i « t ^ o ji 

diftsmKv between decoded $>"«>boK md expectca <.\mbrvife betoic cno^ correction 
30 dtv (Niit $. tipplit^d) It t1*e 1 '«p<.atfc aauthct iiuanuu ol this pix>ee4.s mtfca&iaa; Ihc 
iobui»LKv> sh*?^hiK % m <. iJfi,i< !.3on imt \ d tt.<.t oi) win>£ r^te a< «i factory 



h\ jKUi. w t.j il ^ "iU i (si i I I, u )^ <, njL ?N N 

5 n i ^ p -5k ( ! 1 on Kv. 3 a f wh^chn <if}UtK<;tb to > t t i k ^ 

eCiOuj ^s. ;in <^lIow, ble ra'^ige ur a tl^o hold wbv.h ^oujd roi be e\<.-vC£lie*' 

A aedit ob?<xt crest o pm^m m<5ei1s the >s ^^eti lark fcasb^tlaa iOi i uaj J 
jifto ihe t^adexi iS. do i^nptio i hhi 1 02 a*? aijothei c-Metmg vonsmaJKl \s ^ho^ ii m 

bv ^ 3h I 5 ^ ^ I I I i i vm k> n J V! t o 

^ bui d ^< lb m 1 1 
15 1 UtKsMi >ii,utnlc 1 ton V !, K'<; ■! -> nai il 

1^ |:>ostSv.r5|M FCI HS ?D' ,o'^i4. a 'vci.lo" n -^r ^4 ^ <^n^. 

aoc ifcRts, ssti u a red audio aad MlDt tor aadio, Oi-ia Mi oj MI t i i " io^ x ,dcv> 
and audio. 

Fig " iss d piOw*is. toi emb^dd«jg watcni m »edu ub,ecls» tis^ \g svati-nsiark 
20 tmbcddmg uijjmuind^ H^t piroce5>»* Kgiris whers a listr or appijcat on K^grjm ime t-v 
the watemiark embeddmg faneaon as a rmlermg coHimand ( llOVmto the rendsna^ 
A ^ fho^ Tik (W) I ^ host tfte t) ed <i object dc enbcU m tije tcndcung 
descitoiU N{'>.fi'pan,d.<*K>£leimg i{jt^ie«donjii,r>xo s ( 2t 6 1 

tiK « 1 vH£ 5 k iSti. <. I «(T«m<5Ud ^ d noi<, S he ( J J^T » i h U ■! i'-N 

i"u u 01 tii^. &vU^^^ jak^udatiiK. I4U3 >5 5 Koiuu w it.ate « it i. xU avoid 
t egradaboa 1 * the M>>n. 1 dut, tho tuio l^e^t mJi it> cl li csabs- seat tbio sgH the 
30 traiisaimion cHaxicl ?s 1 KnidcuRg dtSviiptioi hk ^lud laej tu dvfcd «iud ubtdded 
w th div -Vk aid t. at & 0 jerdvu device. 



I- i \. h r 4 1 u i li pi \\ \ t-r 

OliUti, O liU 5 0! fit I Um \ \1 1 51 

n-i \ I lax u ^ o k<, 1u it !, f ^ i s > k^^isHo u 
5 u ? tt n \ I i 3t 5 is u cd i.h t m 1 it ^sn i» t ^ 

clu&tcs«d aot lul fiOTttss etc ), error daft asiors ^t£n.b4stic scicmix^g^ L\t mx>ks ot 
IjaliisaHe watermark anbmdmg methods mslffib: 

1 Adiding a pcB^epU ally tiOtJptui hpi fe'd ispectiom ateim^i^ 1 to tir 
10 tmjty. m tmMi kvel pot pixel ttmrni at the' MftaiK dot jvsiolmjoji before ^.oth «ii1s«^'^ 
U e «n s^'-x, 10 5 hpilf^o^e 5ma<ye 1 he \t s''?^«t'"k %igns\ is cicatcd by con'^-ohmg oi 

us f ii I ! ! «l U! s i 5 5 

^ odu u I r Ml J K it sionhalfloraisgaccoKhig 

,NK)<sulatma mie widths Mftotie dots; 

mio a Mftone image, or modtJiatag haltloue mecm avcoidm^ to predaenmnsd 
relatsonshsp betvie<5a hoi, mo e JBfoxaiation abou* M-at^iinadv fc-mbcddsag isttliods* fot 

SO halftone mjagt-s. I' $ PateatKov 00 0'?4,0M emitfed Mtd>od& and S>*vums Tor 
W ateiitSiUlPi-ocfcssii^go^ I Art Images Q9 6t%22fy muilsdU&iikni- 
^''A^vra^j'rkuu a \d R^lateu «^pphc«to»s, and 9^7 cmiUe<i Ha^fk>t5<. I*rji«tu^ 
■^axntn u\ d Rc'^tca Vu%iiliciliOi$ \\hch wheiCibvmcoipoMculn «et..iO sv 
! in i vN Ji'f o J5d%iioo 0 t, o.t^ \d^r3«« ?smt,esv ut^kM^*«lu< nu ecu 

25 o'^^c 1 ! ! K !so-^n liv Mjo t to -^Ho t Uu n 

U I J U n i i I t !, i f aT5stO!7 d i O Oi. ^ 1 5 

>, ^ n \ I > h ? > s ! h I t ? 5 ? 

30 Ts'tysiv M pAs<^xrti*, nbMstbc\^'3U Baikp '^^ kvd <i itoo smts'>lc%<«l ppio^^ sate tor 
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* b a f J « tH N i -^nx * 

S vjtJeo or audio sj,?»ai rhjjscn^Me^tfo^ wdivim>r\n>->i k'lju ' *hv 

oompniS&io« proc,e&s k> «s -m&d. the vislm«^sl ibal H & id4Ht.d * ^ t id Uv 'i, e , 
cmbeddn^ m (he compi'csscd dita sl-^r oi pmHsliv coTnpK«>«?c<l earn I nc 
comp^es^iOB iaie of the &sg«al ^d^jtn e-iy sei Dy at.teii»Hiu^s the gjca^csst t'xkut 
i)t conspivsiiiors. nets riic aU rm^k^sd signal sis!! surnv es ba&ed on m error d<v.ifisvtjo i 
10 Kiesswrs. StmH ad^'v the perc8pt?ttsl quality pasametss::^ mm be itsed to taBe the 

coix^piession process hO tbat the tomprtsbtua rate j. sckct*d th? t m^^x^taJ.^ t Uv«Uvd 
pcrceptii^ quaiay of ib)j hig^»l ^dtb^ lob^ 1 x K>n v ^ > h \ <^ ^ d 
A^umatix M-^ the aemwi^ fur n M 5 sf^ t ^ s i d5 ' x 

ijaj^«»iH^jot 4.ha?ne1 provides rofoustisjas atidpejx,c i x5 qudi v pdj:..u? ..it, about li^'di 
rtfndmi>g p!w<.>3sg or trs3Ri>mjsfeion cbannd to tfec eoilKjdder movfek ->o tnat ^an 
optjn^.e tte watennark embeddms? for the ptiTticiilar tcadeung pioco"!** or trarismismm 

20 coas*tami& fiiai the v!?-at«H mark emheJdsa mast adhssre to wfols embeddina; Ihe pssyloail 

specified iix the wateimark eaibesddmg coaimaRd> 

Ihc ^ atammk cmboddei modoie quone^ ieaduajag pioccss devjce o*- 

I x^-iion ch^Bd *or It iohu-,t{ie<!v( aid pc c^^pluai qaaht> atinbutes If tbe quahu 

rv u<n, n sir ovit,^ hv.Ttnce;n-<he(if^err^nnt*t^H-,eth:;>oS isnc-so^tl 
25 ^it"3 uk^^inm a il' ^ c ns i 5 s b t ^ H / <ii u u * A s ' ^ 

\ i.t is K Oi I i) I i nil HI Hht iiU<.<.<.r^ 

t i>ed the V A v.'m »rk is o m^nnjii dt-*'' '^loit no t>uv.^pLidl qiu Jul * 1 £, 
-v\ att-mia(k llie s'uiic process csa bs? spphtd to tmc the cmbeddiiig ot>s?iaiJ* n bs^ed m 
30 the iv>bu!stJKii&. att ihine&. ol I'^e readeuBg pjoit^s or itan&jrt&sjon i,iai«>6l If &e 
js xluTOf protss^s N *,\pe<vt&dto Mib<*i mt'al^v dt<fra(*t, the \\ atemiark sdoi?*i,viibditv. 
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cjubk.Odi% couuinuV. can be oc.x»i.H^.dto iv'cvl <iaKmuucailN ti^c ptciv) (\1 , vuratK 
S embedding tnetbod for that device or chatmsL 

Th» wat&mi&xk saibeddlag Bmctioa is pajticulajly well m ted iox oooft>-^sknti 
the emb^din|; of watermarks m \'ector graphies tiset! ia virm&f adverlkmg for 
jstreas Jing media, like ^ireammg vkte, '11 Tirtiwl sdx'Citissitsg is a vector is^apmc 
as a l0gs tbat is sspermipo^d on a vtdeo sejiuenee whea the meai^tng Yideo is 
ID TCttikred m a rsceivitjg device^ such as teiemion equi|>|>ed v?iib a set top box or a 
persosjal csotnputcr on ih. Meract. This Ysci^r gtaf Kio file def wng tlie virtirt! 
advejtismg c^iiiciiide a wato-msilctsibeddUi go on. 1 Ovl s > \* 

IS a> Aui^'je~ lotmleuKtive I V At3t)hcmi^''ns xv'^c in*,? & . ^ Kk^ tr .\ c-^s For 

\?r.t^ilo, tac usa clicks oa(oroitawise selects tli£ loi.o djsflay<,'a on u-^c video \cs?cn 
n %th A cui&or coutjxsl device) to request mteractive mlbtaiatiisu &uob a> d, web page to 
oMer a prodaot or service whea playiug previoiisly recorded or li v® eonteai through a 
personal "video fecordeir like a Tivo machiiie. rbe wstermaik ia tbss logo is tiieu 

20 decoded and a psyioad is exti5acted ii0iuit feat Jtidexss a database eas.^y> The database 
telisms th« mteraotive itifotmatioii (C*Kl, J3T\!Lj web page, etc.) or soaie olh«r 
progranmiabc code tbat executes oia the user's set~iop box or computer md citabk? the 
n3C5 : ^ b«v adrcm<!cd p'V>dact ^i> illustrated In tins cxau^plc ^i^o v attr.i^.aV 
t"-Jv.\kiinj.' coT5.'"^.5 u\}"^- be iSpec^fkd Tor conteai tbat isclBdess a ctrnonjUioTJ o* 

25 ^*Jk n M^t<)Kh!s< %vi-o gtt^pliics, aad aadto« that get oomfeuicd at 
lenaenna. ume m toe receiymg device. 

vv.' pv^ K «pkmon iitxOTis a"v\JM"»e {^co&u cuJutl \m>h^' ? R 
3C) jimpU' nontrd m ma-n t>Uior, d\fi rcitk 'omi^ 1 o provide a coit5prcl^ei)>»!vo di<«jlosvrs? 



5 mxhi i < M t 'k 0!,urjp p < -.'iv •> m be -imp n 1 ^ i ! bo <. %inif ait." or 
a vpc».Kii parpus*. djgitol c^cis t SimtKtth %x\ dil i doci^dutg u^a\ -sc 
ujiplcn cated m i»oftwar<^, jOT^vara ftdrd'^arc, or con hmMiovas, oi t il^vas, i imwate 
aad hxjrd'i^ ar*j The metijod^ aad p^ocessc® dc-cnbcd 8bo^ c mav bo >mj imsi in 
p?x)5s>iTi5^ i-vvscatvid irorn a sj-fatcm's. mmjory (a compiitar jcadaok mediix u such as oji 
10 aeotxome, optical or magneto stoge dewe>, 

Tiieparticulai combmstioas of demei -^nd loatmcs latlxc ib^-m vldml?<? 
srr^bodsr ctU'v ja, ov«,jap^<u J only, ^tt aiteal auijmg aad &ubstji *k xi u Ik tca«,h fijjs 
■mfe DtHT JwN^cb Tigs iTi d^i's a«d iPCOJpor^t«d~fay~n?&rem v, rv.u nK < f pi $ aa. 
aJso coiitejBplated* 
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Wo claim; 

xktt ^ wjivm)\c« bus*. «! m>.'*KKl hi ' i h ) ? u « 

m« \ 
5 one; aiKi 

gioi^ oi ss^ipk*. around each tcaturo accoidaig to 'v^at^ssmaik Sig>^v^. k\et 

3. lk& mtihsd of olsjra 2 wherero the m«sfaa sigsjal au mi^ge, 

4, Hie jsethod of claim I vvhesem watemmfc signal is a aoiss? iaysri 

15 

tiie jasdm sissiaL and a second cvpe ^read arouad the media Signal 

2Q 6< Ffee method of ohm 5 wfeej-iem tfes medja sjgaal is an mj^gs, - 

7, Ihe method of daim 6 whemn the features com|3».mes peaks oi imas>«, 

8 The motliod of claim " wimem &c Jeataies coisipnsc pe-^ks of denvau-v t 
25 of?heimase< 

I hii method ot i.\mn ^ v^h&t^iv the "ieumd type cams,s a. mc^^a^jc. pavload 

30 p3X)p«r^e« feat spabfc s watemmrfe deciofe to soinpemsfe for scalmg tMstor&m by 
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Oirnnuu;!,^' 02 . c.>o\n\\i of^Jjo \^,'uo-fsia'-ked signal <i«<1 deming scaling 

sigskilj aj5d Iramitiom m phase betweoji asljHcea^ gtovtps of sa^npks correjspoRdmg to 
4iff«3retiEt sjfSJibpis^s^ to cbmge slowly. 



12. A metbod Qf steg^ogi-apMcaliy embedclmg a wslmiiarfc ia a media slgruil 
10 comprismg: 

fonning s sieasage composing a FN seqneT$ce of symbols of eitliet 1 or -1 ; 
nuipL-)in>-. the symbols to samples in the rocch.^ ^5gna'; 
sniootbly varying ttajisitioas ia phase between adjao&rJ gvo«ps o.f samples 
co3i'esp0n(^»g to different syaibok. 

IS 

O. The tE€#iod of cisini 12 whoreia media sipalisM at^dio sigasi 

14 A mctbod of decodmg a feature based waterm^k tlmt bides auxjlidrv data 

28 tdsmdfViDg K featuics m tits maha signal, whcff M m am integer greater Iban 

oae; 

decoding a wateimark aronnd tbo K fe^mr©:* by cojxelatijsg sam^^le vaUos m a 
yrotsp of i^mpK« asx^imd each t^amu* w tth a Ateniiask sign ^ >\^i.i 

mms one of tbc N featurtjs as a tetbiencc for decoding .m-^uiaix d%u '01 f-iu v i 
25 more of tljie otber features. 



is. fht me^bod oXGlam 14 whettem the features arep^aiksiu tbets-jedia «ig«.aL 



16. Tfie niethod of cisibi 15 wb#em iii^^ 
3C) Media st^ml. 
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S IN ' * tut aouoUli'^n 1,' \%!>e!C''.Ui5ors„Juis!.a\<1 ^ to^u ^>v s'itU 

auxiliary da$a message^ 

I9i Tfce meliicKiof wlbetem iSt^Itipfe ?3jSf«rssit ^r^^tpmi^^rfe laiyesr^ §te 

10 decoded isclading watermark l&ym &f oiuid the tgatm-es mid elsewfeem 

watemiaiked si^aL 

IS 

dxpJi \\ incrxmk u-^r g a ilm digital wat^niiaiL «mDeiiau^^ tncthod vo5rpns>iH!i> 

deteeteg the Smt dsgltai watermark m the m«dm s^psal; 

smbeddmg message iatomatiOR ftom the fost dxptatw^temiaik mlo a «sccnna 
20 digital watfisimgrfc m the media: sigjjai betbre tiie media si^al mdergoss a 

tr3«sfoii«atio« piocess mch that the f^md digital ^atcsmajt is adapted to stuvi'vv tUe 
traasfomiatiaa process, 

?3 riicmetlioduf elami2i vtlicremfiie secoad digital watemi^ui is i^c^ascd 
25 *a<.k tcklwo to the fet digital vvatermjarKiosui^iys the lOTisforsisatKm 

process. 

^ ^ 1 bo aiet^ od c*<5im 2) \%1ia(\n tfe '5^\''<,sd ajgs^al watennaik ib omht?aded 
' 1^ u Hv vsn M«^^f>.»KJgTa|>h\c embedding inetbod thm the ixtni dxpt&l watermark 
30 embedding misfiKid, 
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4 The nu&odoi d4iT)i2"' \%lh^i^h ihs^ 'u ^dwnJ ^.ikmnikj&at 

5 svmbois and tm.her mc1.adi»«: 

re-cmbeildinfj the m^ssfeage itvrtibob f^0\ the ^r?{ v\ aiwmrk mtx^ tJ^e scc<*iid 

1 0 26, maifejExi of qiasm, 25 ^vhferem ihQ mmmgQ sj^ibois itssrfade an lijd^x to m 

database entry tliat stores iiifoxin&tioB &hmt tlie media sigaaJ« 

2 i The meihod of claim 25 wherein ibe mes^sge svnibt i iicUkic ^ < o'lteni 

dtgu<il v\ neimsijic c .ulfima? to oiini\c the traj-isforaatjoj) ptoces^. <mti u e twouNnios*? 
pariJiiiotct is spocitedby a icudeimg, cdiimg ot teasanssion pixjcoss uj^v ts gom„ to 
2i} process (he media sigjial alter the se«s£>M digjM vwtermark is emhMded m the: media 
i,iwj)a1 -mh to second dsgilal -^atcmwk ij» adapted to tntestastts con^tomN »f {h<. 
xeEdmug, sditing oi-teaasimssjoa. process. 

i*) Th^ mtsthod oCclairti 2f? %herom the rfsbu*5tuo<cs paramekT spccj^ivss 

digiUil nM>*m}^K HO Ihattjie second div^i ft ks.intxUi snuv 'i J\ lo s it^. 
i^aiswoHBatJOis piwess than thefet dlgJtal wstemiai'fc, 

30 'i^Ui,~<<ij>u<,v{'>tosvji<.^aahn miaineta vbat iS* u<;x1 iv>t.oiitH> i,'Ttb»ddum ,oakttt>se 
»^<^^oTid <^*ig3ta1 Jkormark a t><.5 cepiwal quai^t^ .Hiapu*d lot th^> irmk^H t-^-nmovs 
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pr<^CvJv, <ixt< wh«iUi^ peat ^> «J f-ai^BOter sp >.3 a '-t\. \)^!-s. Lxu ^ 

s 1 « s. ^ <<. iplf dti>pt ci-)^ti ahh Uf'AlK mt^Oi tbc v.x u' ; 

H 1 he method of claim 2 i \t h<,rem Ihe ^second d gita! wter a«tk i$ embevldoJ 
ng a l<j>?dbaA.k p occbs tl at ejxate^v cr ^bod& at kdst po^joa^ oi U o &ect nd dig**« 
\v<it<,¥ma-^k and sdectody < di^^^>^^ ih& &UoagtJ3 oi ihs? ccond d^ul watenjt<iik m 
to poxtisms oi &e m«dxa tgna? Acoordmg to degradatoa of the waiOTs-^arl mv<«&axev.l <itxa 
Applvj \g a de^adatlo i pieces^ to 'ss-atcrm* rked isTgnal oi ding to pca^ptiial 

digital %^ atci ^^Uii 8 t -so a iL&t i. at*^ i i?ik c*^ luddi , (<; hod ocj ismg* 
d^-t^itirm the tirst digital -vtat&Tinaik x ihtmodd ij,u<d 
20 conventm?. ihe rmedsa mm&l to a. diffemit fonuat; 

T)i.>eddms mcg,H-^ gc lufon) ^tson fota the Stfet denial 'vv atcmwk t •> ?ecoad 
dsgitil la d c co wetted .soUa such tb^t eco id digital \\atcntjark 

is adapted r<6b\isfeess or perceptibility paraviieiers associated with ije mew fondat. 

23 34, The mediod of claim 33 wlierek dis sew fon«at is a coatpressed tbtmat of 

die media s.kp:jsl. 



35- Tilt: ■;se;h<.jd ordaiaj ?3 wherem die soamd digital wafeauark is encoded 
vA(h p\-i-t.cc sifcir(5! ^-t-rongih ihmi the first diptal wateoBark to survive ttansfetmatioii of 
30 the media sigiial in the «ew Ibrmat 



the aew femat of tke medja slgaal:;^ 

38 ^. coi«p«t6i re-a<^We uieAmJS fiavtng solhs ^re for pcrfommg the 



39, A tetismaikcr toi transmarkmg a m<^ia signal pac^iouslv onbediled >nth a 
first djgttiSl wak » ?i<uk mmg a iij&t dignal ^^-atmaaik <jmbediUut; JutiilxK, v.o-apmmg 
Tvea i-? fo» (. v'O'tt^rK t^iic firs' oiixil ! \s. tonnark n th<; mcha , 

15 N^»tu< « ^ ti ' )' 5Hb> srccn o^^mI DCi.^u tit^iOv,!. a» yi<MUik1o'^N^v& V 

(xamlonnafe^n process- 

A ttaossmaiker Jo tiv^i, :iuuk»g a media agsial pmiouslv ^»«1x.ddod wito a 
i<) lifsl digital -waitijfHiaik u^iug a fci djptal watennark orih^Mmg method compnamg 
means for dstectssg the firsi diptal wafemsark m the m^ja sigssJ j 
me^s tor cosvjsling the media srgsal to a ^tlei^t ibn»at; 
mtam M eiabeddmg me&sage m&rmation Ihsm the K«»t digital afesma^^ ^nto 
a secojid digii^l 'sistermark m the cot*\erted media m^ssI mch ihst the ^4<aond digital 
25 w&im mAtk k adapted to robtistaess oi peiceptiMity paiametcrs associated ■^vith ti>o now 
Msxmt 

4i, A^ftt-movl k\ coukoUmg embedding, 'ff a ^\;3l<-jnoafA >.5 a rood^s 

10 receiviitg s wateuoark eu^bcxldkg ilaiction specj tyiag wstcnisas I cmbc6dLix^ 

paramsiexs, inc1adj«g walen-nark mlens^iiy and message payload; 
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ana 

^ ' ,K i\€±od oTchxm 41 whtjixm ihe ajedm object coinpn&es grat>hK a i 
mcluil^i3|j a colieciioa of two or moro tnxage'? in Mksfsnt $ormv^& 

lii 43. flic mot&od of cldtitj 41 v^h&tun metlia ol-yect c<j»ipi5st;& a mus^c 

md the stegsno^aphie esnbsd^ng process asiaptsd to the robmtoess or psmsptoai 
quality par&taete selected: at tlie tendermg time-. 

qvmhtjf paratiietei^ sdcoted at the rcadsrmg teae^ 

4^, lh& mefhod. of ciMm 41 whsrem the st^sganograpMcsanbeddrng process 

20 itemtively smbeddisg the message payload m two or more lisaratioss; 

aialyzm^ tSxe etrof detection rate of The message payload m each toation; ajjd 
adjiistmg a robusstxjsss par^met«^ of tbs embedding pmcs^s for st kast one of 
iterations so that tJjc cim det'^ttoa rate is at an lacceptabie level. 

25 4t5. Liie method of clatm 41 mciiidu^: 

n>'\HNr«tc^ «otmowdit\ctcut\'s.atcnmtkei>\bt<M'B-. ^<f<!^Ls c-u.i-'l 'Ht,<l 
J !v u<a rfunL pu ■> s i - sen 

;taus««&?j,ou clianiiei to wbieh t^iS medM oHect is lo bt iippjii.d 
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47 1 he t«<?tbod of i.l4xm 41 % hu em tbo w aiouBarl cntbsddmg •^''jraior 
5 V ivi vt t- IK i^i selects ifee eaxibtad^Bg locaiOBS of Iht Atern^k dt,,^ea<hftg o» t;^*. 



tte siegasjogrsphic embedding pjoccss embe<S& the watcnsiark mcss<»gc payloas^l inxa ihtt 
ID im<^ge sScr rhe image is ^ ajsiei i^ed mto a foraul comj>AlibIe wilh s pilmei on -^KfJi 0 
atiage IS 10 be tsrmied. 

50 Xbc X lethod d^n 5 1 ^hcivin the •^"s. ^ion^ i le^vu^ p " 1o "U lis 



n mv*^ o („ i >i s. r o ^tKv,U\ H conn o'" uavf'i< 
V. bjcv.t I KimK » V a '^im i K mbcdtn U \ >Wi o dc dppbc.*? to tbc mv.duj object, 
20 th-^ A « k ca^boudj ij, toic^on inchidmg a m atej m<ul aiessasi® pavload, and 
p^ssidSiN contiolhag cmbeddug oi die wat«^miaik messiae pa^load m tlie siedia 
abject; 

ws^s loi cieatmg a rcnd^nng des>i nptio ? gio ao<H nb»«g how to rentier tfe^j 
iBsdiaobjecnasd 

2S ax\i^(.n i\ i b id rmodaltjfor ^te«,!saogrpphiu!l> emhetkijng fee 



^ > d<3ijt§ modiil*,i> toi dittemt rend^rmg p'oce^scb 

30 



ii, N s<-en{ v>I t. < jTu 1 w^v-u m (''a. \inK\ ddcr mc>(i i e js o ^e'^iijb to 
J vi 1 > ^ » >i n i n*.<«\ 'TOv.s-i. p ivio<k 1 1 ti»v, aKUj* ob oct f> u o or i 'or<? 

S 

dtfgi addition pieces'? to a %%atsa -aark^xl mcd a s ga&l output f om ter<JtJ0t^ before 
analyzmg estot deteetioB rate. 

10 55 l\ e systeiTJ of cimm 51 whemati e media obicct oompnss"? graphic t^a^ 

}<5 ks&t -iii part ^pei,ified by a tuiiki mg eomn aiid tl at 1 ot be comvned mti a 
i js«y! </CiJ 5(na|is wJ e« tfee %vait;rmark embedding fimction i uisejted m ih& midenug 
tectiptio?! ffie> 

15 56. Tistf Vvs.!e^Uv>r claim 51 -ivfeerem the j^o-o:;;;. ebji^oi C'^jpiXso jirueliut'd 

audio represented, >it las: k- |\;r?. h} {eu>krir>; cooinu^^-J fn.st hrs^- ;-!Oi lux u convericd 
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